"The highlighted tokens are primarily functional morphemes, particles, and common suffixes in Japanese, as well as high-frequency content words and grammatical connectors. These elements are essential for sentence structure, meaning, and cohesion, often marking relationships between clauses, indicating grammatical roles, or forming key parts of compound words and set phrases."
Score Type | Accuracy | Precision | Recall | F1 score | TPR | TNR | FPR | FNR |
---|---|---|---|---|---|---|---|---|
detection | 0.8 | 0.941 | 0.64 | 0.762 | 0.64 | 0.96 | 0.04 | 0.36 |
fuzz | 0.66 | 0.621 | 0.82 | 0.707 | 0.82 | 0.5 | 0.5 | 0.18 |